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PACKAGE METADATA AND TARGETING/ SYNCHRONIZATION SERVICE 
PROVIDING SYSTEM USING THE SAME 

Technical Field 

5 

The present invention relates to a package metadata 
and targeting/synchronization service providing system; and, 
more particularly, to a package metadata and targeting and 
synchronization service providing system that can apply 
10 Digital Item Declaration (DID) of- a Moving Picture Experts 
• Group (MPEG) 21 to television (TV) -Anytime service. 

Background Art 

15 Targeting and synchronization service, which is now 

under- standardization progress in Calls For Contributions 
(CFC) , which is Television (TV) -Anytime Phase 2 of Metadata 
Group, is similar to a personal program service which is 
appropriate for an environment that consumes user 

20 preference suggested conventionally and new types of 
contents including video, audio, image, text, Hypertext 
Markup Language (HTML) (refer to TV-Anytime contribution 
documents AN515 and AN525) . 

That is, the targeting and synchronization service 

25 automatically filters and delivers personalized content 
services properly to a terminal, a service environment, and 
user profile in consideration of synchronization between 
contents. 

Hereafter, the targeting and synchronization service 
30 scenario will be described in detail. 

Family members of a family consume audio/video (AV) 
programs in their own ways in a home network environment 
connecting diverse media devices, such as Personal Digital 
Assistant (PDA) , Moving Picture Experts Group (MPEG) Audio 
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Layer 3 (MP3) player, Digital Versatile Disc (DVD) player 
and the like. 

For example, the youngest sister who is an elementary 
school student likes to watch a sit-com program on a High- 
5 Definition (HD) TV, On the other hand, an elder sister who 
is a college student likes to watch a sit-com program with 
a Personal Digital Assistant (PDA) through multi-lingual 
audio stream to improve her language skill. 

As show above, the contents consumption pattern is 
10 different according to each person and it depends on a 
variety of conditions such as terminals, networks, users, 
and types of contents. 

Therefore, a contents and service provider in the 
business of providing a personalized service properly to a 
15 service environment and user profile requires sl targeting 
service necessarily. 

Also, the TV- Anytime phase 2 allows users to consume 
not only the simple audio/video for broadcasting but also 
diverse forms of contents including video, auciio, moving 
20 picture, and application programs. 

The different forms of contents can make up an 
independent content, but it is also possible to form a 
content with temporal, spatial and optional relations 
between them. In the latter case, a synchronization service 
25 which describes the time point of each content consumption 
by describing the temporal relations between a plurality of 
contents is necessary to make a user consume "the content 
equally with the other users or consume it in the form of a 
package consistently even though it is used several times. 
30 There is an attempt to apply the MPEG-21 Digital Item 

Declaration (DID) structure to the embodiment of metadata 
for TV-Anytime targeting and synchronization service. 

Fig. 1 is a diagram showing a conventional schema of 
the MPEG-21 DID, and Fig. 2 is an exemplary view of a 
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Digital Item (DI) defined by the conventional MPEG-21 DID. 

As shown in Fig. 1, DID elements of MPEG-21 defined by 
16 elements can form a digital item including different 
media such as audio media (MP3) and image media (JPG) , 

5 which is shown in Fig. 2. 

The basic structure of the MPEG-21 DID can be used 
usefully to embody package metadata for TV-Anytime 
targeting and synchronization service but the problem is 
that the DID elements of MPEG-21 are too comprehensive to 

10 be applied to the TV-Anytime service. 

Therefore, it is required to embody package metadata 
that can supplement the DID elements more specifically in a 
TV-Anytime system to provide an effective targeting and 
synchronization service. 

15 In order to identify packages and constitutional 

elements, the temporal and spatial formation of the 
constitutional elements and the relation between them 
should be specified. Also, metadata for conditions 
describing a usage environment in which the target service 

20 is used should be specified, and metadata for describing 
information on the types of the components should be 
embodied specifically. 

Disclosure of Invention 

25 Technical problem 

In order to cope with the above requests, *the present 
invention provides package metadata for a targeting and 
synchronization service and a targeting and synchronization 
service providing system by applying Digital Item 

30 Declaration (DID) of Moving Picture Experts Group (MPEG) -21 
efficiently. 

Other objects and advantages of the present invention 
can be understood in the following descriptions and they 
can be understood more clearly from the embodiments of the 
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invention. Also, it can be understood easily tha.t the 
objects and advantages of the present invention can be 
realized by the means described in claims and combinations 
thereof, 
5 Technical Solution 

In accordance with one aspect of the present invention, 
there are provided package metadata for a targeting and 
synchronization service that can provide a variety of 
contents formed of components to diverse terminals d_n the 

10 form of a package in a targeting and synchroni zation 
service providing system, the package metadata which 
include: package description information for selecting a 
package desired by a user and describing general 
information on an individual package to check whethor the 

15 selected package can be acquired; and container ni&tadata 
for describing information on a container which is a 
combination of diverse packages and formed of a set of 
items, each of which is a combination of components. 

In accordance with another aspect of the present 

20 invention, there is provided a targeting and 
synchronization service providing system using package 
metadata for providing a variety of contents, each formed 
of components, in the form of a package by targeting and 
synchronizing the contents to diverse types of terminals, 

25 the system which includes: a content service providing unit 
for providing the contents and package metadata; . a 
targeting and synchronization service providing unit for 
receiving and storing the contents and the package metadata, 
obtaining a component and a content matched with service 

30 request conditions requested by each terminal through 
analysis, and providing the matched component and content; 
and a terminal controlling/reproducing unit for 
transmitting the service request conditions which are 
requested by the terminal to the targeting and 
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synchronization service providing unit, and receiving the 
content and the component matched with the service request 
conditions from the targeting and synchronization service 
providing unit. 

5 

Advantageous Effects 

The present invention described above can apply Moving 
Picture Experts Group (MPEG) -21 Digital Item Declaration 
(DID) to television (TV) -Anytime service effectively by 

10 discriminating constitutional elements from packages , 
specifying temporal, spatial, and interactive relation 
between the constitutional elements, specifying conditions 
of metadata describing an environment used for a. targeting 
and synchronization service, and providing concrete 

15 metadata describing each constitutional element. 

Also, the present invention can provide package 
metadata for a targeting/synchronization service and a 
targeting/synchronization service providing system. 

In addition, the present invention can provide a 

20 targeting/synchronization service effectively in an MPEG 
environment by utilizing MPEG-21 DID and embodying the 
package metadata. 

Brief Description of Drawings 

25 

The above and other objects and features of the 
present invention will become apparent from the following 
description of the preferred embodiments given in 
conjunction with the accompanying drawings, in which: 
30 Fig . 1 is an entire schema structure of Moving Picture 

Experts Group (MPEG) -21 Digital Item Declaration (DID) 
according to prior art; 

Fig. 2 is an exemplary view of a Digital Item (DI) 
formed by a conventional MPEG-21 DID; 
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Fig. 3 is a block diagram describing a targeting and 
synchronization service providing system in accordance with 
an embodiment of the present invention; 

Fig. 4 is a tree diagram illustrating component 
5 identification information in accordance with an embodiment 
of the present invention; 

Fig. 5 is a block diagram illustrating package 
metadata in accordance with an embodiment of the present 
invention; 

10 Fig. 6 is a diagram describing a usage environment 

description tool of MPEG-21 Digital Item Adaptation (DIA) ; 

Fig. 7 is diagram illustrating package metadata in 
accordance with another embodiment of the present 
invention; and 

15 Fig. 8 is an exemplary view showing a use case of an 

education package utilizing the package metadata in 
accordance with an embodiment of the present invention. 

* Reference numerals of principal elements and 
description thereof 

10: targeting and synchronization service provider 
20: contents service provider 
30: return channel server 
40: PDR 
11: storage 
12: service analyzer 
13: service controller 

Best Mode for Carrying Out the Invention 
30 

The above and other objects, features, and acdvantages 
of the present invention will become apparent from the 
following description and thereby one of ordinary skill in 
the art can embody the technological concept of the present 
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invention easily. In addition, if further de-tailed 

description on the related prior art is determined to blur 
the point of the present invention, the description is 
omitted. Hereafter, preferred embodiments of the pxesent 
5 invention will be described in detail with reference "to the 
drawings. The terms or words used in the claims of the 
present specification should not be construed to be limited 
to conventional meanings and meanings in dictionaries and 
the inventor (s) can define a concept of a term 

10 appropriately to describe the invention in the best manner. 
Therefore, the terms and words should be construed ±n the 
meaning and concept that coincide with the technological 
concept of the present invention. 

The embodiments presented in the present specification 

15 and the structures illustrated in the accompanying drawings 
are no more than preferred embodiments of the present 
invention and they do not represent all the technological 
concept of the present invention. Therefore, it should be 
understood that diverse equivalents and modifications exist 

20 at a time point when the present patent application is 
filed. 

Fig. 3 is a block diagram describing a targeting and 
synchronization service providing ..system in accordance with 
an embodiment of the present invention. 

25 As shown in Fig. 3, the targeting and synchronization 

service providing system of the present invention comprises 
a targeting and synchronization service provider 10, a 
content service provider 20, a return channel server 30, 
and a personal digital recorder (PDR) 40. 

30 The targeting and synchronization service provider 10 

manages and provides a targeting and. synchronization 
service in a home network environment in which a multiple 
number of devices are connected. 

Also, the targeting and synchronization service 
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provider 10 receives package metadata for targeting and 
synchronization,, which are metadata for targeting and 
synchronization, through the PDR 40 which is a personal 
high-volume storage from the content service provider 20. 
5 The package metadata are important and basis data for 
determining the kind of a content or a component that 
should be transmitted to each home device. 

The package metadata describe a series of condition 
information, contents and components information that is 
10 suitable for each condition. The actual content and 
component corresponding to the package metadata are 
provided by the content service provider 20 or another 
return channel server 30. 

Meanwhile, the targeting and synchronization service 
15 provider 10 includes a content and package metadata storage 
11, a targeting and synchronization service analyzer 12, 
and a targeting and synchronization controller 13. 

The content and package metadata storage 11 stores 
contents and package metadata transmitted from the content 
20 service provider 20. 

The targeting and synchronization service analyzer 12 
analyzes inputted package metadata containing a variety of 
terminals and user conditions from a PDR 40 and determines 
a content or a component that is matched with the input 
25 conditions. Herein, the content or component selected 
appropriately for the input conditions may be only one or 
may be a plurality of them. 

The targeting and synchronization controller 13 
provides attractive metadata and content /component 
30 identification information to the PDR 40. 

If the analysis result of the targeting and 
synchronization service indicates that a plurality of 
contents or components are matched, the PDR user selects 
and consumes the most preferred content or component based 
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on the attractive metadata. 

Hereafter, a method for identifying the package and 
component will be described. The package is formed of 
diverse types of multimedia contents such as video, audio, 
5 image, application programs and the like, and the location 
of the package is determined as follows. 

If a package is selected in a searching process, the 
identification (ID) of the package is transmitted i_n the 
process of determining the location of the package. 
10 Differently from a conventional component determining 
process which is terminated after a content is acquired, 
the package location determination of the present invention 
further includes a step of selecting an appropriate 
component in the usage environment after the step of 
15 acquiring package metadata and a step of determining the 
location of the selected component. 

The steps of determining the location of the package, 
selecting the appropriate component, and determining the 
location of the selected component are carried out in 
20 different modules with different variables, individually . 
In the process- of determining the location of the package, 
it does not need to know what factors determine the pa.ckage, 
because the metadata of the package are simply sent to 
middleware for TV-Anytime metadata. Therefore, the ID of 
25 the package can be Content Referencing Identifier (CRID) 
which is the same as the ID of the content. 

Table 1 shows Extended Markup Language (XML) syniiax of 
package identification information embodied in the form of 
CRID. 
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Table 1 



<PackageDescription> 
<PackageInformationTable> 
<Container crid="crid: //www. imbc. com/ Package/ Education /CNNEng_Kor w > 
<Item> 



Fig. 4 is a tree diagram illustrating component 
identification information in accordance with an embodiment 
10 of the present invention. 

As shown in Fig. 4, the component identification 
information of the present invention includes imi, CRID and 
a locator. 

In order to determine the location of the component 

15 without control of the user automatically, the component 
should have an identifier that can identify the advantage 
of media having a different bit expression, just as others. 
As the identification information of the component, CRID 
can be used along with an arbitrary identifier, i.e., imi. 

20 The arbitrary identifier, imi, is allocated to each 

locator to obtain a location-dependent version based on 
each content and it is expressed in the described metadata. 

The locater is changed according to a change in the 
location of the content. However, the identifier is not 

25 changed. The identifier of metadata is secured only within 
the valid range of CRID which is used by being linked with 
metadata containing information reproduced during the 
location determination process. 

Table 2 shows an example of component identification 

30 information embodied in the XML in accordance with the 
present invention, and Table 3 presents the above-described 
package and component determination process. 
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Table 2 



<Item> 






<Coitiponent> 






sOonaix.ion lequire- 


aUQIO WAV / S 




< Re source mimeType= 


"audio/wav" crid= 


"crid: / /www. imbc.com/ 


EngScriptperPhrase/ 


FirstPhrase" imi= 


"imi:l"/> 


</ Component > 






<Component> 






<Condition require= 


"Audio_MP3"/> 




< Resource mimeType= 


"audio/mp3" crid= 


"crid: //www. imbc.com/ 


EngScriptperPhrase/ 


FirstPhrase" imi= 


"imi:2"/> 


</Component> 






</Item> 
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Table 3 



Procedure 


Sub- Procedure 


Result 


Note 


Search 

Package 

Metadata 


User interaction 


CRID of 
Package 
metadata 


Same as 
the CR for 
Content 


Location 
Resolution & 
Acquisition 
of 

Package 
Metadata 


Using authority of package 
ID {CRID) and RAR, determine 
the location of resolution 
server • 


Physical 
Location of 
Package 
Metadata 


Send CRID to an appropriate 
location handler 


Location handler looking for 
broadcasting channel or 
requesting get_Data to bi- 
directional location 
resolution server 


Get the location of package 
metadata 


Acquisition of package 
metadata 


Package 
Metadata 


Choice of 
Items 

/Components 


To make a choice of 
items/components automatic 
without user intervention, 
usage description is used. 


List of 
Components 


Additional 
steps for 
Package 


Resolution of 
Components 


Get the location of 
component using CRID+imi 


Physical 
Location of 
Component 


Acquisition 
of Components 


Acquisition of component 


Components 





Hereafter, package metadata for the targeting and 
5 synchronization service in accordance with the present 
invention will be described. However, description on an 
element that performs the same function as an element of 
the MPEG-21 DID under the same name is omitted. 

Fig. 5 is a block diagram illustrating the package 
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metadata in accordance with an embodiment of the present 
invention. 

As illustrated in Fig, 5, the package metadata 
(PackageDescription) of the present invention include a 
5 package information table (Packagelnf ormation Table) and a 
package table (Package Table) . 

The package information table (Packagelnf ormation 
Table) provides description information for each package, 
such as the title of the package, summarized description, 
10 and package ID. It allows the user to select a package the 
user wants to consume and check whether the selected 
package can be acquired . 

The package table (Package Table) is a set of packages 
and a package is a collection of components that can widen 
15 the experience of the user by being combined diversely. The 
package table (Package Table) can be described through 
container metadata. 

Herein, the container metadata include ""descriptor , ' 
^reference/ and *item.' 
20 The A item' is a combination of components and it forms 

a container. It can include an item and a component 
recursively. The ^reference' is information for identifying 
a package and a component, which is described above, and it 
describes the location of an element, such as an item and a 
25 component . 

Also, the "descriptor" is information describing a 
container and it includes ^condition, ' Mescriptor, ' 
^reference,' * component, 9 x statement, ' relation metadata, 
component metadata, and targeting and condition (Targeting 
30 Condition) metadata. 

Hereafter, the component metadata will be described. 
The component metadata include identification information, 
component description metadata for describing general 
particulars of a component, and it further includes image 
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component metadata , video component metadata, audio 
component metadata or application program component 
metadata according to the type of the component. 

As described above, the identification information 
5 includes CRID, imi, and a locator. 

The component description (BasicDescription) metadata 
have a complicated structure that defines items describing 
general particulars of a component. It includes information 
describing general particulars such as title o:f the 

10 component, component description information (Synopsis) , 
and keywords. The keywords form combinations of keywords 
for the component, and both a single keyword and a 
plurality of keywords are possible. The keywords follow the 
keyword type of the TV-Anytime phase 1. 

15 The image component (ImageComponentType) metadata have 

a complicated structure for defining elements that describe 
attributes of image components. It describes media-rrelated 
attributes of an image, such as a file size, and still 
image attributes (StilllmageAttributes ) information^ such 

20 as a coding format, vertical/horizontal screen size and the 
like. 

Table 4 below is an embodiment of the image component 
metadata which is obtained by embodying a 702 x 2 40 gif 
image and a Hypertext Markup Language (HTML) document 
25 related thereto in the XML. 
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<Item> 

<Component> 
<Descriptor> 

<ComponentInformation xsi: type="ImageCoinpoiientType"> 
<Cou^onentType>iniage/gif</ContponentType> 

<ComponentRole href="urn: tva: metadata: cs : HowRelatedCS : 2 002 : 14"> 
<Name xml : lang="en">Support</Name> 

< / ComponentRol e> 
<B as i cDes c r ip t ion> 

<Title>Book Recommend (Vocabulary Perf ect ) </Title> 
<Rel at edMaterial > 
<Medi aLo ca to r> 

<mpeg7:MediaUri>http: //www. seoiln. com/banner/ vocabulary /- 
vocabulary . html</mpeg7 :MediaUri> 
</MediaLocator> 
</RelatedMaterial> 
< / Bas i cDe s c r ip ti on> 
<Medi aAt t r ibut es > 

<FileSize>15000</FileSize> 
< /Medi aAt t r ibut e s > 

< S t i 1 1 ImageAt t ribut es > 

<HorizontalSi ze>720</Hori zontalSi ze> 
<VerticalSize>2 40</VerticalSize> 
<Color type=" color "/> 
</ Still ImageAt tributes> 
</ Component I nfo rmat i on> 
</Descriptor> 

<Resource mimeType— " image /gif" crid="crid: //www. imbc . com- 
/ImagesforLinkedMaterial/EnglishBook.gif "/> 
< / Compone nt > 
</Item> 



The video component metadata have a complicated 
5 structure for defining elements that describe the 
attributes of a video component. It describes media-related 
attributes of video such as a file size, audio related 
attributes of video such as a coding format and channel, 
image-related attributes of video such as 

10 vertical/horizontal screen size, and motion image-related 
attributes of video such as a bit rate. 
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The audio component metadata have a complicated 
structure defining elements that describe attributes of 
audio components. It describes media-related attributes of 
audio such as a file size, and audio related attributes 
5 such as a coding format and channel. 

The application program component metadata have a 
complicated structure defining elements that describe 
attributes of an application program component. It 
describes media-related attributes of an application 
10 program such as classification information of the 
application program and a file size. 

Hereafter, the relation metadata will be descr±bed. 
The relation metadata describe relation between the item 
and component for formation and synchronization between 
15 components. 

In order to describe the relation metadata, the 
metadata relation between the component and the item will 
be described first, hereafter. 

A component model can describe diverse 'relations' 
20 between the components by referring to Classification 
Schemes (CS) and using terms such as 'temporal,' 'spatial,' 
and 'interaction.' The components are applied to the items 
of a package. 

The 'relations' between defined components, between 
25 items, and between components 'and items are useci to 
represent how the components, items, or components and 
items are consumed in an abstract level rather than to 
represent precise synchronization which requires entire 
scene description such as SMIL, XMT-0 and BIFS simply by 
30 using terms pre-defined in the CS. 

For example, a component can be consumed prior to 
other components by using time-related 'precedes' without 
the entire scene description. 

Particularly, in the targeting and synchronization 
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service,, the relation met.adata include interaction CS 
information for informing relative importance of the 
components, synchronization CS information for informing a 
temporal sequence for component consumption, and spatial CS 
5 information for informing relative location of each 
component on a presentation such as user interface. 

The relation metadata are refined based on the concept 
of "relations' defined in the MPEG-7 . 

The MPEG-7 Multimedia Description Scheme (MDS) 
10 includes three types of delations/ which are "Base 
Relation CS (BaseRelation CS),' "Temporal Relation CS 
(TemporalRelation CS),' and "Spatial Relation CS 
(SpatialRelation CS).' 

The CSs correspond to the Interaction CS 
15 (InteractionCS) , the synchronization CS (SyncCS) and the 
spatial CS (SpatialCS) , respectively. 

The base relation CS (BaseRelation CS) defines 
"topological relation' and "set-theoretic relation.' As 
presented in Table 5 below, the topological relation 
20 includes "contain' and "touch, ' while the set-theoretic 
relation includes "union' and "intersection.' 

Since the topological relation can express a 
geometrical location of a constitutional element, it is 
useful to use the topological relation to express the 
25 spatial relation. Therefore, the "relations' from "equals' 
to "separated' are refined and added to the spatial 
relation CS (SpatialRelation CS) . 

Herein, although the set-theoretic relation describes 
an inclusive relation and an exclusive relation, in the 
30 present invention, it is defined as describing relative 
importance of a component. 
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Table 5 



Relation Name Inverse Relation . Definition ProperUes Informative Examnles 

equals equals B equals 'C ' /" Equivalence 



if and only if 
• \ B=C ' 


C B 




, inside contains- \B h . B& » Ba Partial order 
. inside C- ' 
if and only if 


°H 




covers coveredBy B h B& ... ' j& . Transitive ' 

~.L.\ . . ... .;.-*.,!. : poyers C . _ ; 

■ ■ ; if and only if . . 
I* * * % 1 Bb ;W j5S» V— M* 
I. % B*yC =>- C AND' • 






•overlaps . ..■ overlaps • " B overlaps. C ;. ■ . Symmetric 

if and only if • , 


B 




JS' c\ C has non- , 
• ... '~---.--~^w;«»*=«empt^ ■. 




G 


.touches - -touches . Bl Bz - \B> . Equivalence 


touches 0 . • B 
; t , if and.only if ... . 

* *£fh- V . Mv-^ 
/\-'Z'';-".: */ - -AwC---.. •■ - is " ' ' - . 
\ ... - " • % - * • connected " • * 


- C 




: disjoint .disjoint * • _ ' Jg ais joint C" . . Symmetric 

L.\'.:..™ .^/ ! ' ' " > ^arid ahly'if . >: : 
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Table 6 



Term 


Relation Description 


And 


Components must be provided for user experience at one time 


Or 


Components can be chosen among them 


Optional 


Components can be consumed or not by user 



In the meantime, the temporal relation CS is a_s 
follows. The following tables 7 and 8 describe temporal 
5 relation. 

The table 7 describes binary' temporal relations, whiLe 
the table 6 describes n-ary temporal relations. 

The items of table 8 below are a name of * relation' , 
names in 'inverse relation' thereto mathematically, 
10 properties of the relations, and usage examples. The table 
8 identifies the name of 'relation, ' defines the relation 
mathematically, and presents usage examples thereof. 

The synchronization CS (SyncCS) can substitute the 
temporal relation CS (TemporalRelation CS) one-to-one and 
15 it can be extended based on table 9 below. 
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Table 7 



Relation Name • 


Inverse 


Definition 


Properties * 


Examples Gnformative)- 




Relation 










-U110W3 


B precedes O . 


TVansitive . 


BBB CCC 






" if and only-' if " 










"R \\ C C a. 






meets 




B meets C 


Anti-symmetric 

* * ** * ■ * 


BBBCCC 




..." 


if ana only- if 










B.D - ua 


** 




. nvcirl 'arse . * * " 


ovexlappeciBy. 


B overlaps C 




*"• "BBB 






if and only if 




CCG 






is. a % Ca AND b»d > 






■• : 




U,a AINU 13, D \ .V,D 






...... 

contains 


\\ .-.>.- 

during 


- * " '- rt\ : «zmrcvg- u-« -.v-- t 

B cont ai ns C . 


IVansitive 


Any of the examples for 






if and. only if. 




strictContains, s^arteoBy, 






fCa > AND C b < 




ana -iinisnecLpy, 




■ . 






















• B strictContais 


^IVansitive- 


B3BBBBB- 


•»* * . - * 








• CCGO- • 


' . ■ i 




ix- ana ouiy h. 


*■ . * * * • 




• ■ .-• ' 














•m' • . .".",.* .• 1 . . ... - 




* \... " - ■ '■• ' 


starts 


i?f- e>H Wkt ' . 


v-JEffigMCBftJifr ,„ , , , , ;„. 








. . .. , - .. . 


l^.an^oiuy it. 


.-*•. ■/ .-="'-- -i' • ,-*- 




... . .... 






'*■ * "■ \ -" 








Vr»u 






finishes 


finishedBy 


B finishes C 


Transitive • • 


"■ BBBB 






if and on ly if 




CCCCCC - 






B.a > C.a AND B.b 83 










Cb- 






coOocurs. 


coOocurs " 


B coOccurs C 


Equivalence 


B.BB - 






. if and only if 




CCC 






B.a = C.aANDRb.= 










Cb 







20 



WO 2005/031592 PCT/KR2004/002494 



Table 8 



Relation Name 



Definition . 



Ekiampies (informative) 



contiguous 



Aii Pi2* ...'.An contiguous 
if and only if 

Atb » Ai+i.a for i^l, n-1 

That is, At, Aa»'...» An contiguous if arid only 

if they are tenlporally disjoint .and connected. 



AjAiAaAaAfr-AiJVaAa 



sequential 



Ai» fat — An sequential 
if and only if 

As.b < Ai+i.a for i=l, ... n-1 

that- is, Ai, A2, Aj sequential if. and only if 

they are temporally disjoint and not necessarily 

connected. 



A^A-jA* A 2 A 2 ..A a A B A n 



coBegin 



Ai, Aa; ... An coBegin, * * • 1 . AiAjAi 

If and pnlyjf ■ * , ' A2A 2 

Ai.a '» Aji-i.a for i=i, n-1 ~ 

That is, Ai, A2, ...i A« coBegin if and only if A^AjAi 
they start at the same time. . 



coEnd 



Ai, Ag, An coEnd 
if and onlyif 

Ai.b =.Ai+r.b for i=l t .i, n-1 

That is,.Ai, Aa, ... An coEnd if and only, if 

they end at the same time. . 



AjAxAi 
A2A2. 

AAAi" 



-parallel 



;Ai»A2, '../Ad parallel 1 AjAiA^ 

if and only, if ' A2A2 
the interaction of •A^.^':»\^ : h^'rae' : non-' 

empty- interior/ : * . . ,..</.'" • . AAA 



..overlapping 



. A*, A$, ... An bve'tlappincr.. :* . .; A A r A x - . . . _ 

* if .and; fcnly if. . " , V "... . AaAiAalfe- . 
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Table 9 



Term 


Relation Description 


MPEG 7 MDS 


TriggeredStart 


A component makes the other (s) 


starts 


TriggeredStop 


A component makes the other (s) 


finishes 


TriggeredPause 


A component makes the other (s) 




Before 


A component precedes the other (s) 
in presentation time 


precedes 


Behind 


A component follows the other (s) in 
presentation time 


follows 


Sequence 


Components are started in sequence 


sequential 


Concurrent lyStart 


Components are started at same time 


coBegin 


Concurrent lyStop 


Components are stopped at same time 


coEnd 


Separate 


Components are operated at 
different time with a time interval 




Overlap 


The start time of component is 
later than that of other one, and 
faster than end time of other one. 


overlaps 



5 The following table 10 shows temporal relation between 

components using the temporal relation CS (TemporalRelation 
CS) . 
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Table 10 



<Choice minSelectioiiS="l" maxSelections*"l n > 
<Seiection select_id="Tenpj:oBegin ,, > 
< Descriptor > 

i <Relation type="urn:mpeg :npeg7 : cs : TemporalRelationCS : 

2001:coBegin n /> 
; </Descriptor> 
; </Selection> 

! </Choice> _ 

Meanwhile, the spatial relation CS (SpatialRlation CS) 
will be described hereafter. Table 11 below defines tine 
15 spatial relation (SpatialRelation) . The table 11 identifies 
the name of relation and the name of inverse relation, 
defines mathematical relation, describes additional 
attributes, and presents usage examples in the items. 

The relations from 'south' to 'over' are based on the 
20 spatial relation (SpatialRelation) . The relations from 
'equals' to 'separated 7 are added to the 'SpatialRelation. 7 
The spatial CS (SpatialCS) can be substituted by the 
spatial relation CS (SpatialRelation CS) one-to-one and ±t 
can be extended by an additional need. 



5 
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Table 11 



Relation 
,Name 



Inverse Relation 



'Definition ; ' 



Properties . . Informative Examples 



•south 



north. 



B south G y \ 

Hand only if . 

( (Bxa C^a AND. 

BxJ>. Cjtb). <5R . 

(Bjca ?s^C.x.a -AND . 

Bicb feC-Xb) ) AND 

B.y:b£C.y.a 



■Transitive 



west' 



east 



ffiwest" C7 • : " Tfafisitfve' 
' if and drily if ; 

(CB;y.a >• C;y;a '/dsiD ; 
• Biyib dy.b>* OR . 

(B.y.a <' *dy.a -jbNb "\ - - 
. B'y.b >^y-b)) . : / 



B 



northwest ' southeast 



: Rnorthwest G 

if iai^ cwily if 

BT£¥"^"CxTa~^D 
JB.y.a> C,y,b . 



Transitive 



•southwest ' northeast 



.B southwest :C 
if andonlyif . *.* 
. B:x;b ' < :C.X.a;. AND 
B:y.b> d7;g . • v ' 



Transitive 



B 



jf aridd^yif, 

3ELxb..< .C^ca. ; ■ 



B 
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below ,% : " ' above 



B belpwC" . 
Hand only if . 
B.y.b<CXy.a 



Transitive 



.. under 



r 



BbverC : 
"if arid only if 
'((Bxa'. s- Cjca AND. 
Bxb > Coca) QR 
(Bxa; > Cxa AND 
B^ca < C jcb)> 
AND B.y<a = Cyb 



Transitive 



B 




C 





'.equals. 



equals 



B equals C '} 
iifc.ahd only if J 
B«C •*'.• V 



Equivalence 



C , B 



inside'. : ■ : ' contains Bl, B2, Bh- inside * Partial prcier 

if and only if. 

(Bl; B2, Bn) eC 



B 



covers* 



cbveredpy"^^ Transitive. 

. if and only if : 

B1V kj B2. •'. o.^u 
.. • * ' ■" Bn.tX: z> C AND* (Bl. 

... - M. B2. vj...O Ba.CC>.»£ • 



B 



overlaps . overlaps^ . • B overlaps C ; Syminetric 

-:.rV:- : r : vV ' *• " /lif .arid oiiy if 

■•'*':'*" % /': * "7* -i^S^.'^ "* hasv'nanr • ; / v 

: -; ; y -v • .' vT'^^^i^^i j^X?Qg ;7;^7"- 



B 



)•':• ■■■ Bii;/--B&r - fr^\13tt- -.Eqpiyalence. . 

' .tquche9;.G \ *" , V.-. • . 
:.. ; .:. p and pnly-if ... . . . 

. :Bfc..-"u B2: w.v.u- 



touches • -touches / 
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Bii,vjC; is .connected 



disjoint , . disjoint 



B disjoint C 
♦ if and only if 
tfrvC = 0 



Symmetric 



B. 



separated. ; separated 



E separated O 
- if ahd.oiily if 

EkcI<b)~0AND / 

cl(E)r\O==;0 

where cl(S) indicates 

the closure of a set- 
's,. * - -."-I.. : : ' 



Symmetric 



10 
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Hereafter, the targeting condition metadata will be 
described. The targeting condition metadata describe usage 
environment conditions for supporting item/component auto- 
selection according to a usage environment for targeting. 

To describe the targeting condition metadata, the 
structure of the MPBG-21 DIA, which is used conceptually in 
the present invention, will be described first. 

In order to provide a targeting service that provides 
more appropriate and efficient user experience for a given 
usage environment, a package should include a series of 
usage environment metadata, such- as terminal conditions, 
user conditions, and content conditions. The usage 

environment metadata are related with a plurality of 
constitutional elements in order to represent usage 
environment conditions needed for consuming the related 
constitutional elements precisely. 

Although there are a lot of non-standardized metadata 
which describe the usage environment, a usage environment 
description tool of the MPEG-21 DIA provides abundant 
description information on diverse attributes in order to 
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provide adaptation for a digital item for transmission, 
storing and consumption. 

Fig. 6 is a diagram describing a usage environment 
description tool of the MPEG-21 DIA. 
5 As illustrated in Fig. 6, the tool includes a user 

type (UserType) , a terminal type (TerminalsType) , a network 
type (NetworksType) , and a natural environment type 
(NaturalEnvironmentsType) . 

The user- type (UserType) describes various user 
10 characteristics including general user information, usage 
preference, user history, presentation preference, 
accessibility characteristic, mobility characteristics, and 
destination. 

The terminal type (TerminalsType) should satisfy 

15 consumption and operation restrictions of a particular 
terminal. The terminal types are defined by a wide variety 
of terminal kinds and properties. For example, the terminal 
type is defined by codec capability which includes encoding 
and decoding capability, device property which include 

20 properties of power, storing means and data input/output 
means, and input-output characteristics which includes 
display and audio output capabilities. 

The network type (NetworkType) specifies network type 
based on network capability which includes a usable 

25 bandwidth, delay characteristic ,and error characteristic 
and network conditions. The description can be used for 
transmitting resources usefully and intensively. 

The natural environment type (NaturalEnvironments 
Type) specifies a natural usage environment which includes 

30 location and usage time of a digital item as well as 
characteristics audio/visual aspects. It also specifies the 
characteristics of illumination that senses whether visual 
information is displayed for the visual aspect, and it 
describes noise level and noise frequency spectrum for the 
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audio aspect . 

The targeting condition metadata suggested in the 
present invention include the properties of the MPEG-21 DIA 
tool and have an extended structure. 

As shown in Fig. 5, the targeting condition metadata 
of the present invention describe usage environment: 
conditions for supporting automatic item/component 
selection based on a usage environment. The targeting 
condition metadata include user condition metadata 
(UserCondition metadata) which describe a user environment, 
such as user preference, user history , serge information, 
visual/auditory difficulty information; terminal condition 
metadata (TerminalCondition metadata) which describe a 
terminal environment; network condition metadata 
(NetworkCondition • metadata) which describe a network 
environment connected with a terminal; and natural 
environment metadata (NaturalEnvironment metadata) which 
describe a natural environment such as the location of a 
terminal . 

The following table 12 presents an embodiment of an 
XML syntax using the targeting condition metadata of the 
present invention . 
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Table 12 



<Choice rainSelections^"!" maxSelections="l"> 
<Selection select_id="Audio_WAV"> 
<Descriptor> 

<TargetingCondition> 

<TerminalCondition xsi : type="dia : CodecCapabilitiesType"> 
<dia : Decoding xsi : type="dia: Audi oCapabilitiesType"> 

<dia : Format href = "urn: mpeg :mpeg7 : cs : FileFormatCS : 2001 : 9 W > 
<mpeg7 :Name xml: lang= ,, en">WAV</mpeg7 :Name> 
. </dia: Format> 
</ dia : Decoding> 
</TerminalCondition> 
</TargetingCondition> 
</Descriptor> 
</Selection> 
</Choice> 



In the table 12 , "TargetingCondition" includes user 
terminal descriptive metadata which indicate a terminal 
30 capable of decoding a wave file format (wav) . 

Fig. 7 is diagram illustrating package metadata in 
accordance with another embodiment of the present invention. 
The package meta data suggested in the present invention 
can have the structure illustrated in Fig. 7. 
35 It is obvious that the contents signified by the 

constitutional elements of Fig. 7 are the same as the 
contents signified by the constitutional elements of Fig. 5 
which have the same name. 

Fig. 8 is an exemplary view showing a use case of an 
40 education package utilizing the package metadata in 
accordance with an embodiment of the present invention. 

In a home network environment with a variety of 
household electric appliances such as Personal Digital 
Assistants (PDA) , Moving Picture Experts Group (MPEG) Audio 
45 Layer-3 (MP3) players, and Digital Versatile Disc (DVD) 
players, it is assumed that a user watches CNN News for 

29 
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studying English. If the user misses part of the news 
content or comes across a difficult sentence or phrase, the 
user can refer to education data added to the news content: 
by using a reference identifier. 

The education data, particularly, data for language 
education, can be provided in the form of a package having 
a plurality of multimedia component such as media player, 
repeat button, sentence or phrase scripter, directions for 
exact listening, grammar and dictionary, which is 
illustrated in Fig. 8. 

All the components that form a package should be 
stored in a PDR (PDR) before the user consumes them. In 
case where all the components are available, the user 
interacts with the package rendered to the user interface 
in the user terminal through an input unit . 

The following tables 13 to 16 are XML syntaxes where 
the education package of Fig. 8 is embodied in the package 
metadata suggested in the present invention. 
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Table 13 



<?xml version= r '1.0 " enc oding= "OTF- 8 " ? > 5 

<TVAMain xmlns= "urn : tva : metad a ta : 2 0 02 " 

xmlns : mpeg?= "urn: mpeg: mpeg7: schema : 2001" 

xmlns : di a= " ur n : mp eg s up og2 1 : 2 0 0 3 : 01- DIA-NS " 

xmlns: xsi="http: //www. w3 • org/ 20 01/ XML Schema- instance" 

xsi : schemaI»ocation="urn: tva: metadata: 2002 . /PackagelfiithDID2 . xsd"> 

<Packag eDescription> 

< PackaqeInf ormat ionTabl e> 
|<Container cri(^"crid://www,imbc.ccMn/Package/Education/CNMEng_Kor^> | 
<Item> 

<Choice min3elections="l" maxSelections="l"> 
<S election select_id="Phrase_One"> 
<Descriptor> 

< Statement mimeType= "text/ plain" > Phrase One</Statement> 
</ De sc riptor> 

</ 3 el e cti on> 2 5 

<S election s el ec t__id= "Phr a 3 e_Two "> 
<Descriptor> 

< Statement mime?ype= "text/ plain ">Phr as e Twro</ Statement> 
</Descriptor> 
</Selection> 
</Choice> 

<Choice minSelections* 5 "!" maxSelecti.ons="2 "> 



<S election select_id="Interaction_Optional"> 
<D escr iptor> 

<Relation type^^rn: tva: metadata : cs: Inter actionC 3: 
2003: Optional "/> 
</ D e sc r i p t o r> 



O el ecti on s el ect_id = "T emp_c oB egin "> 
<Descriptor> 

<Relat±on type 25 "urn: mpeg :mpeg7 : cs:TemporalRelationC3 
2001 : coBegin lt /> 
</ D e sc rip to r> 
</?electpion> 



</Choice> 

<Choice minSelections="l " max3elections="l"> 
<S el ecti on s el e c t_id= "Audi oJWAV "> 
<Descriptor> 

<T a rg etingC onditi on> 

<T erminalC onditi on xsi : typ e= "di a : C od ecCap abiliti e sTyp e "> 
<di a : Decoding xsi : type= "di a : AudioC ap abiliti esType "> 
<dia : Format href = "urn: mpeg : mpeg7 : cs : PileFormatCS 
:2001:9"> 
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Table 14 



<mpeg7 : Name xml : lang= n en l, >WAV</inpeg7 : Name> 
</dia: Formats 
</dia : Decoding> 
< / T e rminalC onditi on> 
</TargetingCondition> 
</ D e sc ripto r> 
</ 3 el ecti on> 

<S el ecti on s el ect_id= "Audi o_MP3 "> 
<D e scripto r> 

<T a rg etmgC onditi on> 

<0!e rminalC ondition xai: type="dia:CodecCapabilitiesType fr > 
<dia : Dec oding xai : typ e= "di a : AudioC ap abili ti esTyp e "> 
<dia: Format href="urn:mpeg:mpeg7 : cs:FileFormatC9: 
2001:4 W > 

<mpeg7:Name xml:lang="en">MP3</mpeg7 : Name> 
</ di a : F o tmat> 
</dia: Decoding> 
</T e rminalC onditi on> 
</ 3? argetingC onditi on> 
</D esc ripto r> 
</ 3 el ecti on> 
</Choice> 
<Item> 

<C onditi on requir e^Phr ase__One Terap_c oB eg in "/ > 
<Etem> 

<Component> 

< Condition r eg uir e= "Audi o__tt3AV " / > 

<Re source mimeType= " audio/ wav" crid= "crid: //www. imbc. com/ 
Engacrip-fcperPhrase/FirstPhraae" jmi—^imi: l"/> 
</ C omp onent> 
<Component> 

< Condition r equir e= "Audi o_MP3 "/ > 

<Resource mimoType= " audio /mp3 " crid="crid: / /www. imbc . com/ 
EngSeriptqperPhrase/FirstPhrase" xmi^imi: 2 "/> 
</Component> 
</Item> 
<C omp onent> 

<Resource mimeType= "text/ plain" crio^ "c rid: //www. imbc . com/ 
Eng Sc riptp e rPhra se/ Fir s tPhr a a e . txt'7 > 
</Component> 
<C omp onent> 

<Resource mimeTyp e= "text/ plain n crid= r, crid://www.imbc.com/ 
KorScriptperPhrase/FiratPhrase. txt"/> 
</ C omp onent> 
</ltem> 
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Table 15 



<Item> 

<Condition r equir e= "Phr a se_Two Temp_coBegin rr /> 
<C omp o nent> 

<Re source mimeType= "audio/ wav" crid="crid:/ /www. imbc. cam/ 
Eng 3c riptper Phrase/ Second Phrase . wav"/> 
</ C omp one nt> 
<C omp onent> 

<Re source mimeType= "text/ pi a in" crid="crid: //www. imbc. com/ 
EngScriptperPhraae/3ccondPhraae.t3ct ,f /> 
</ C omp onent> 
<C omp onent> 

<Resource i»imBType= "text/plain" crid= w c rid: //www. imbc . com/ 
KorScriptperPhrase/SecondPhrase. txt w /> 
</ C omp onent> 
</ltem> 
<Xtem> 

<Condition require= "Interaction Optional "/> 
<Camponent> 
<Descriptor> 

<Compon8ntInfonnation xsi: type= "3teageCQmponentn?ype "> 
<C omponentType>image/gif </Comp onentT ype> 
<C omponentRole hret= "urn: tva : metadata : cs : 
HowRelatedCS ; 2 002 : 14 "> 
<Name xml:lang= ,, en ,r >3\jpport</Name> 
</ C omp on entRol e> 
<B a sicDe sc ripti on> 

<G?itle>Book Recommend (Vocabulary Perf ect) </Title> 
<Re 1 at edMa t er i al> 
<MediaLocator> 

<mpeg7:HediaUri>http: //www. seoiln. com/banner/ 
voc abul a ry/ voc abul ary. html </mp e g7 : Medi aUr i> 
</MediaIiocator> 
</ Rela tedMate r i al> 
</ B a sicD e ac ripti on> 
<Mb d i aAttr ibut e s> 

<File9ize>15QO0</FileSize> 
</Medi aAttr ibut e»> 
<StillXmageAttributes> 

<Hor iz ontal Siz e>7 20 </ Hori z ontal si z e> 
<Vertical3ize>240</Vertical3ize> 
<Color type= ,, color ,r /> 
</ 3tillImageAttributee> 
</C omp onentlnf ormati on> 
</Descriptor> 

<Resource mimeType= fr image/gif " arid.— "crid : //www. imbc- com- 
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Table 16 

/imagesf orLinkedMaterial/EnglishBook. gif "/> 
</Component> 
<Camponerrt> 

<Resource mimeTyp e== "image/ gif " crid="crid: //mm. imbc.com- 
/Imagesf orLinkedMaterial/StudyMethod. gif "/> 
</Component> 
</ltem> 
</ltem> 
</Container>. 
</PackageInf ormationTable> 
</PackageDescription> 
</TVAMain> 

20 

The components in the boxes in the contents of th.e 
tables 13 to 15 stand for relation metadata, targeting 
condition metadata and component metadata in accordance 
with the present invention. 

25 The method of the present invention can be embodied d_n 

the form of a program and stored in a computer-readable 
recording medium, such as CD-ROM, RAM, ROM, floppy disks, 
hard disks, electro-optical disks and the like. Since th.e 
process can be easily executed by those skilled in the art, 

30 further description will be omitted. 

While the' present invention has been described with 
respect to certain preferred embodiments, it will t>e 
apparent to those skilled in the * art that various changes 
and modifications may be made without departing from th.e 

35 scope of the invention as defined in the following claims . 
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